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ABSTRACT 

Necessary definitions and theorems from real variable dealing with 
some properties of Lebesgue-Stieljes measures, monotone non-decreasing 
functions, Borel sets, functions of bounded variation and Borel measur- 
able functions are set forth in the introduction. Chapter 2 is concerned 
with establishing a one to one correspondence between Lebesgue-Stiel jes 
measures and certain equivalence classes of functions which are monotone 
non decreasing and continuous on the right. In Chapter 3 the Lebesgue- 
Stieljes Integral is defined and some of its properties are demonstrated. 
In Chapter 4 probability distribution function is defined and the no- 
tions in Chapters 2 and 3 are used to show that the Lebesgue-Stiel jes 
integral of any probability distribution function can be expressed as 
a countable sum of positive numbers added to the Lebesgue-Stieljes inte- 
gral of a continuous probability distribution function. The conclusion 
indicates how the Lebesgue-Stieljes integral may be used to define the 


probability associated with a Borel set of real numbers. 
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Chapter 1 
INTRODUCTION 

The terminology and notation used in the thesis is defined below. 
Certain elementary theorems are stated without proof and proofs are indi- 
caced for a few properties of Borel sets, Lebesgue-Stieljes measures, 
functions of bounded variation and Borel measurable functions. These 
theorems and properties are used in the subsequent chapters. The proofs 
are included in the introduction to avoid breaking the continuity of 
various discussions. 
DEFINITION 1.1 

R is the collection of all real numbers. 
DEFINITION 1.2 

R* is the collection of all real numbers and +00 
DEFINITION 1.3 

A set is any collection of real numbers. 
DEFINITION 1.4 

A class is a collection of anything other than real numbers. 
DEFINITION 1.5 

An algebra A is a non empty class of subsets of R such that if A 
and B are in X so is AUB and if A is inA so is A. 
THEOREM L.1 

An algebra A is closed for the taking of finite unions and inter- 
sections, R and @ are elements of A. 
DEFINITION 1.6 

4 @-algebra 5 is an algebra where every union of a countable 


number of sets in & is again in oS - 
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THEOREM 1.2 

A o-algebra | is closed for the taking of countable intersections. 
THEOREM 1.3 

There exists a minimal o -algebra which contains the class of all 
intervals, 
Proof: Let K denote the collection of all o-algebras that contain the 
class of all intervals. The class of all subsets of R is an element of 
K and therefore K is not empty. Let 

re POCO an K} 

Then {4 is a o -algebra and if Q.is a G -algebra in XK, 44 is a sub- 
class of Q. Further @®contains the class of all intervals and hence 
is in Kk. 1 is therefore the minimal o-algebra containing the class 
of all intervals. 
DEFINITION 1.7 

The class {4 is the class of Borel sets. 
DEFINITION 1.8 

A function on A to B mates every element of A, the domain of the 
function, with a unique element of B. It is not necessary that all ele- 
ments of B be used, 
DEFINITION 1.9 

A set function, P , is a function on a given class of sets to R* 
such that @ mates at least one set to an element of R. 
DEFINITION 1.10 

A countably additive set function, DP, is a set function such that 


Oo 
for every UA- in the domain of P where the Ay's are disjoint sets 
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pC UA.) = > DP Az 
Lz isi 
DEFINITION 1.11 
A measure is a non-negative, countably additive set function 
‘ 
defined on an algebra. 
DEFINITION 1.12 
A Lebesgue-Stieljes Re gear ey Lt) is a measure that mates finite 
numbers to finite intervals. 
THEOREM 1.4 
bets be a Lebesgue-Stieljes measure. If B,;CBg and both B, and 
Bj are in the domain oy) then 
BES BQ. 
Proof: Since B9-B, = Bo(\By, , B5-B, is in the domain oes 
PLO 2> LLCS s | 
= ACBL B+ UB, 
2B, 
THEOREM 1.5 
i a is a Lebesgue-Stieljes measure, then 


pgpro 
Proof: 
BA = plA+ J) 
A+ WP. 
DEFINITION 1.13 


26 is the class of all monotone non-decreasing functions defined on 


R and continuous on the right. 
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DEFINITION 1.14 

F, and Fy are r-related if F, and Fy are functions in MC that 
differ by a constant. 
THEGREM 1.6 

The r-relation divides AC into equivalence classes. 
Proof: The r-relation is evidently symmetric, reflexive and transitive. 
THEOREM 1./ 

Every function in ML is in one and only one equivalence class. 
DEFINITION 1.15 

E is the collection of all equivalence classes mer. 
DEFINITION 1.16 

Let F be a function defined on R and let b be an element of R%*. 


Suppose F is such that lim F(x) exists and, in case b s+o0 , 
K—» - co 


lim F(x) exists. Define F(-0cco) = lim F(x) and in case b z400 
K —F ~ Oo X-—m = DO 


define F(b) - lim F(x). If there exists a "finite partition", 
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20a = XU mK Sere <Xn2b, 
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for some real number k, then F is a function of bounded variation on 
(-co, b J . Incase b :z+00 , F will be said to be of bounded varia- 
tion on R (or simply a function of bounded variation.) 
THEOREM 1.8 

If F is of bounded variation on (-c¢ , b] , then F equals the dif- 


ference of two monotone non-decreasing functions on (-o, b| . The proof 
of th. ft P| ae 
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LEMMA 1.8.1 


For every finite partition of (-02 ,b | ; 


Sarees a | Fx; eae 


Soe 


DEFINITION 1.16.1 


The total variation of F on (-c7,b | : es is 


sup Z \ Fcx) fac |! 


b 
Evidently Vio < le, 
LEMMA 1.8.2 
For every finite parcition of (-22,b] 


PCB ye ets) = eee ae Zk 


where 2, is the sum of all the positive terms in eee y= Fp] 


w= 


and >__is the sum of the other terms. 
DEFINITION 1.16.2 


The positive variation of F, p 2, » is the supremum of ae over 
all finite partitions of (-e,b]j . The negative variation of 


F,N_& , is the supremum of —2.~ for all finite partitions of 


Gee,b]. 

LEMMA 1.8.3 
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On the other hand for every €>0 there exists a Finite partition 


of y-2o .& | such that 
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Hence for this partition a similar argument shows that 


Te Zz L vee -€ + F(b)-FeExXd] 
and 
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Thus the lemma holds. 


LEMMA 1.8.4 
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Proof: These equations follow from adding and subtracting the equa- 


tions of the preceding lemma. 
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LEMMA 1.8.5 
For all x, 


Foy: P2-LN oH Fie) | 


rx oe , then 


N-w S No and Pies PS 
Proof: Obviously 24 cannot be greater for Goo,x | than for 


Geax) Similarly - 2. — cannot be greater for Ceo, x] than 


fone (co, x | - The theorem follows from lemma 1.8.5 and lemma 1.8.6. 
DEFINITION 1.17 

A function g is Borel measurable if { x: gc > ke} is a Borel set 
for every k. 
THEOREM 1.9 

If g is Borel measurable, then Sx: g(x) <k$ : { x: g(x) < kf and 
\x: g(x) >k} are Borel sets for every k. 


Proof: Since 


{u: gov 2ak} = {x: Qixr< k} 


for every k and the Borel sets are closed for the taking of complements, 


‘ 


fx: g(x) < k $ is a Borel set for every k. Since 


a fx:q@r<cks +}s ie qos} 


for every k and the Borel sets are closed for the taking of countable 


intersections, { x: g(xy< Kk} is a Borel set. Finally { x: g(x) > k $ 
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is a Borel set for all k because 


{xi qusk}= {xs goork b. 
THEOREM 1.10 
If g is a Borel measurable function, Kg is a Borel measurable func- 
tion for every fixed real number K. 


Proof: When kK = 0, the theorem is obvious. When K >0 


Baas ake k 
oe K qo kb ere q(x) 2 =}. 


When K < 0 


“KK atx) Caves > atx)S Rk ; 
§ x qcxvr2 ier Gee a 
THEOREM 1.11 
If 81 and 8. are Borel measurable, then g) +85 is Borel measurable. 


Proof: [If 8, (x) + 84%) gk, there exists a rational number r such that 


QZ r< le-Gt™). 
Hence writing the rationals in a sequence fr ,1r9,°"", 


oS 
Si * ya + sien <- Ok«: Qicr<r ffx: 9,00< <= 168 | 
i= | 
On the other hand, if there exists a rational number r, such that 


8 (x) <4, and Bo(x) ¢k-ry, then 8 (%) +8504) Sk. It follows that 
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THEOREM 1.12 


If for every n, g, is Borel measurable and if 


lim g,(x)® g(x) 


A ~~ ao 
then g is also Borel measurable. 
Proof; Take an x in { x: g(x) <k ; and choose m large enough that 
] a 
as => Lk qo] . Because of convergence there exists an N such chat 
for every n>N 
Qa < Goo + < k- +. 


Hence x is in 


ie) O a {xs qwek- Oh, 


On the other hand take x in O O 7\ oe Grid k- a} 
mei Nt! nena, A 


Then for some m there exists an N such that for every nN, 


Gntxd <e-+. 


Because of convergence 


QS k-i.<k. 


Hence x is in 


{ x: qor< kt. 
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Taking complements and observing that the Borel measurability of the 
8, 3 implies the set on the right is a Borel set, it follows that 


{x:: g(x) 2 k } is a Borel set and hence g(x) is Borel measurable. 
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Chapter 2 
FUNCTIONS OF AC AND LEBESGUE-STIELJES MEASURES 
It will be shown that there exists a biunique correspondence between 
the equivalence classes in E and all Lebesgue-Stieljes measures on @. 
For every M in E there exists a unique Lebesgue-Stieljes measure, 
js such that for each F in M and for every a < b 
AA6a,b] = Ce) - Fea) 
The proof of theorem 2.1 proceeds as follows: 
DEFINITION 2.1.1 
Ce 1g, Ca,v] , Cow, bl ; (a ,70) (K for every ox Lb} 
LEMMA 2.1.1 
C, is closed for the taking of finite intersections. 
LEMMA 2.1.2 
The complement of any set in C, is in C, or is the union of two dis- 
joint sets in C). 
LEMMA 2.1.3 


The union of any two overlapping or abutting sets in Cy is in Ce 


DEFINITION 2.1.2 


JAP =O 
JA basb 1 = F(b) - Fla) 


C- Oo = lj x 

MM bo | pal ak ib | 
(a,o)= lim Ca, x] 

JA : ys a,x 
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LEMMA 2.1.4 
Every F in a given M determines the Same AA . 
DEFINITION 2.1.3 


Co : JA: either A is in C) 


or A = U A; where the A;'s are 
disjoint sets in om 
LEMMA 2.1.5 
C)O Cy 
LEMMA 2.1.6 
Cy is closed for the taking of finite unions. 


vi 
Proof: First consider that if A is in C, and oH B; is such that every 


Ni 
B; is in Cy ley By UA is in C,- This follows from the distributive 
i-l 


law for unions, Lemma 2.1.3 and the definition of Co. Again considering 
the distributive law for unions, the union of any two sets in Co is in 
Cy. The lemma follows by induction. 
LEMMA 2.1.7 

‘Ca is closed for the taking of finite intersections. 
Proof: The lemma follows from the distributive law for intersections, 
lemma 2.1.1, the definition of Cy, and induction. 
LEMMA 2.1.8 

Cy is closed for the taking of complements. 
Proof; If A is in Cy and every A; is in Cy 
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a= 2 ae 
=(\ A; 
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Ic follows from lemma 2.1.2 that every Ay is in Cy. The lemma follows 
from lemma 2.1.7. 
LEMMA 2.1.8 
Cy is an algebra of sets. 
DEFINITION 2.1.4 


For every A in Co let 


ja Z BAL 


where .U a.=A and the A,'s are disjoint sets in C,. 
i=l 1 1 i 


LEMMA 2.1.9 
JA is uniquely defined on Co. 
Proof: If S= U S, where the S,'s are in C,, then S=U A. where 
i=] ya i=l + +s 


i Src Le || which implies the A,'s are disjoint and in C,. 
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UB, , the Aj's are disjoint sets in C, and so are P,'s 
a= y=! 


I: follows that 
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pre = PMB o A.) and Bey 


It follows that 


A w= 1 ‘ 
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LEMMA 2.1.10 
If A and B are in Cy and +B, 
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Proof: Since B-A = BOA is in Cy > 


BBs uL6B-A) UAL = 4 (B-A) + A 
LEMMA 2.1.11 
/* is countably additive on Co. 
Proof: [It is sufficient to show that if UW A; is in C5 and the A; 's 


az 


are disjoint sets in Cc, , then 


BCU Aj) = 2 AG 


Ae = 4 


oo 
Consider first that if (a,b] equals \J (a, »d;] where all the in- 
he) 


La) 
tervals are disjoint, then WU (a,b, ] is a subset of (a,b]. Hence for 
i=] 


all n, 


jf (a,b] 2 Z paz, by] 


It follows that 


JR CO. , odie cs YANO. ;, sae). 
The same inequality follows in a similar fashion for 4 (a,o2) ; 
palace se) and ,R. 

To show the reverse inequality, first consider a and b finite. 
Since F is continuous on the right, for every €>0O there exists a 
§>0 such that 

Flar+ds < FlCal+ € 


Moreover for every i, there exists an 4,;>0O such chat 


E( baie < FCoue ce 2. 
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Hence by the Heine Borel theorem there exists an integer m such that 


gees i.) -C U C ai, b,+i). 
Consequently, renaming the end points of the intervals if necessary, 
a+ §& is in (2,.b)+47 ? and for some integer k between 1 and n inclusive 
b is in (ap ster vip.) 

Suppose the least k is one. Then since [a+§,blis a subset of 

(a,,b,+ “ID » it follows that 

F(a) < FtCars) < FB Lal+e€ 
and 

Be Cera) < Gb itec 20 7 
Hence 

F(b) -Fta)-€ < Flb,)-Fla,y+ €27 


Ic follows that 1 (a,b1 <p (a,,>,4 which implies that 


Oo 
lables Fe nea, oid. 
Suppose the least k is greater than one. Then b> b+ “Gy ) 

which implies that b,+v{, is in (a,b]. Since b,+¥{, is not in 
(a) ,b)+ 1) there must exist an integer j greater than one such that 
bit vf, is in (a, ; 2 ee If j is not two, let the jth interval be 
second and the second, the jth. Then 

ay < Dirty] < bot Yl/2- 
This procedure may be repeated if necessary until the firsce (ay byt 1) 


where b< b+ "L: Then 
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and for every integer j such that 1 <j ¢ k 


eee (er ys 
Since F is non decreasing, it follows that 
R 
2. LE(bryn) -FCal= Fioye ye) - Eta, 
R= 
+ = LF (bi +14) - Fraz dd 
A =| 
2 FCbl+ vin) -F 6a) 
> Flo) - FC ard) 


> Fib)- Fray-€. 
However 


k k ko, 
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It follows that 


E le 
Z_|Fb;)- Faz) > Fb) -Fiay-€ Bi 22) 


oe 


w= \ 
Since this inequality holds for any integer greater than k, 
om 
a pee > w6a,bd. 
Therefore for a and b finite, 
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Assume now that (a,o0) equals WU (a, ,b,] where 
jam | 
é =ajy< by Fags’ where lim b,= oO. For every finite value of x 


Y\ = GO 
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greater than a, (a,x C (a;,b. . It follows that there must be a 


b x, 
n 


Yence 


Bax) Ce bend - F6a,) 


an 


aed ec) 


as 


<2 eee) — 


‘ee 


om 


= ee Ge, be 
7 i ewe 


Similarly it may be shown that if (-0o,b] equals OU (a,,b,] 
aa 


(o ) 


jp 6-2, 8) aS 2 paz, oz] 


ona 
and if Requals U (a, ,b;] 


de =I 


USS a (64, 0.). 


Nn" 
Finally every set in C, may be expressed as U A, where the A,'s 
wy =I 


a Coo 
are disjoint sets in C,- If UA, equals eo) 


gt i= | 


(a;,b, J , it follows 
that 


a) 


eo] 
anil So Wrage el| = Caz bz | and Y Caz bi In A.> an ‘ 


AS a consquence 


N 
i CO ae a BLA, () Ca, , 6,1] 
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and 


MAS= Zp Liar, bn Ad 
ee pl Mee leat QAI 


Hence 


es Liar bInAd 
<= es 5 Ses a —\ PB ’ 
v\ yn 
Zz ma as per 6an e,IAsh 
=! he= \ 
= Zz JAS en Pi . 


a =| 


Letting m go to infinity gives 


i yan. = plu Als = J aa 4 
Hence 


| Ghee Cae = 
MUL Y Caistox dd = 2. 6 ai,bil, 
LEMMA 2.1.12 
éM is a measure on C4. 
DEFPMITION 2.1.5 


For any subset, S, of R let 


ps S = inf 5. es. 
=I 
where every A, is in Cy, the A,'Ss cover S and the infimum is with re- 


spect to all countable sequences of sets in Cy which cover S. 
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LEMMA 2.1.13 

js is defined for all subsets of R. 
LEMMA 2.1.14 

If Ads in Co , 


J A= pA 


Proof: Take any countable sequence of sets from C., which covers A. 


Denote the members of the sequence by By »Bos+-- : Then define 


n-\ 
A. ce AN Cae UY oe 
rey 
OS 
Then A is in Co, the A\'s are disjoint and U A, =A . It follows 
A= 


from lemma 2.1.11 that 


>) 
pA= 2 BAL. 
Since for all n, A, is a subset of B, from lemma Pll OF 
3 a 
Be See a 
ee ei 7 os 
Hence 
oO 
BA 4 ia 


To complete the proof consider the sequence A,@,@,... 


Lom, C At+ MPS +p Pee : 


» 
If wA is less than LA, there will exist a sequence of sets 


By »Bo,--- from Co which covers A and is such that 


i oO 
JA Ar E> 2 RB, 


Lo 
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where Se le sy A > o.. This implies that 


MA ? ene. 
which is impossible. Hence 


pA BEA 
LEMMA 2.1.15 
x 
peo 
LEMMA 2.1.16 


x ¥ 
If S, is a subset of So) & Si SM oF 
LEMMA 2.1.17 
If S is covered by a sequence of sets, SprSareee 5 
¥ a t 
BM SS 2 Se 


Proof: The statement is trivial when A4"S is infinite. When 1A"S is 


finite for every S; and every € > O there exists a sequence of sets from 


Co ) Mito.» » Wnach cover Sy and are such that 

Op { 2 

Za SM oie 
Hence 

Cm CO oH " 

aga Ax: oe 

fer c= ye *s : z i ee 
Since S is covered by S,,S9,... and S5 is covered by ApprSgogeres it 
follows that S is covered by AyyrApooees . Hence 

¥ “a ae a 
us 5 <p Oi 
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DEFINITION 2.1.6 
The class of oe sets of real numbers, C3, is the 
class of all sets of real numbers A such that 
3 
Sd pe CSNA) + (3-A) 
where S is an arbitrary set of real numbers. S is called a test set. 
LEMMA 2.1.18 
gd is in C,- 
LEMMA 2.1.19 
If Ais in C3, A is in C3. 
LEMMA 2.1.20 
a] 
me M89 3°°° A, is a finite sequence of sets in Cy, U A; is in 
pat { 
C3. 
Proof: Using induction, suppose A, and Ay are in C3. Then for every set S, 
PIS CEN) ee 
Using S-A,; as a test set, 


ye (S-A,) Pay) (9-A,NA,) + Coie ae 


Hence 
BES > wh CSNA) UF (S-ALN AZ) Hp (SAAD), 
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=X LSA (AU Ag) + u* CS- (A, Az) 


The lemma follows by induction. 


LEMMA 2.1.21 


If Aj,AQ,°°*, An is a finite sequence of disjoint sets in Cy and S 


is any set of real numbers, 


iain | 
pt (SAU Aj) Se OT 


A= 1 


Proof: Using induction again, the statement is trivial when n = l. 


Making the induction hypothesis, using lemma 2.1.20 to assert that 


K='t 


n+ I 
U A; is in C3 and using S&S AY A, aS a test set, 


m (SAU A;) > whCSAU A; AUA;) ee (SAU Ay JA;) 


_- 
- 


> ESA AL) +t CSMAna) 
By the induction hypothesis 
wh SOA) = 2 wk (Sn Ay). 
It follows from lemma 2,1.1/7 that 
wCSAY Ax) g 2 ps COMA ey 


Therefore 


Vi 1 


po(SNU Ay) = Zp CSAA,). 
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Gad Sie > T= 
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LEMMA 2.1.22 


If A,,Ag,-.. is a denumerable sequence of disjoint sets in C4 and if 


S is an arbitrary set of real numbers, 
PECSNU AL) = & e® CSMAg) 
hit Ras Ve 


rn. ss 
Proof; Since, for every n, U A, is a subset of UA, , it follows 


wah 


that 


PCO ALAS) > eh CU ALS) 


& a yi (AAS) 


=I 
Letting n go to infinity, it follows that 


pe | UALAS) 2. rs we (ALAS) 


Since A, AS,A29S,.-. cover U CALMS) it follows from lemma 2.1.17 


that 


peru A, AS) & > ye CA; N95) 
Thus 


tt: _ k | 
ys CUS), 2 pr CaS) 


ae ie 
ee | 


LEMMA 2.1.23 


108 Ay, ,Ag,--- is a denumerable sequence of sets in C3, U Aj in C3. 


La 


Proof: Taking only A,,A,,°°" ,4, it follows from lemma 2.1.20 that for 
an arbitrary set S, 


B*S> pk (SAG AL) +8 (9-0 Az), 
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Moreover from lemma 2.1.20 


{i 


5 YC SMA;) 


a= 


Vs (SAU A; ) 


and from lemma 2.1.16 and the fact that U Ke SO 


u=' joa 


Lat 


be ( S-U Ax)S te (S- lA) 


Thus 
‘ is t t rere, 
SX EZ pECALNS) +p CS-U Ag) 


Letting n go to infinity 


os 
ps Se E ph (A,n§) + -*(S-OAz). 
rom roa 
It follows from lemma 2.1.22 that 
oO oS 
a > > pe Co U Ai) + A (5-UA,;) 
= ee | 
od 
It follows that UWA; is in C3. 
n= 
LEMMA 2.1.24 
Co is a subset of C3. 
Proof: If A and B are two arbitrary sets in Co» A(\B and A-B are 
disjoint and in Cy. The union of AMB and A-B is A. 
Hence 


WE CANB) + * CA-B) = LEA, 


2 ® * * 2 e e 
For S, an arbitrary set of real numbers, if jas is infinite 


pe 32 pF COMA) +e" (9-A) 


Sorvall A in Co 
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If .°S is finite, then from the definition it follows that for 
every ¢€>0O , there exists a sequence, Aj,A9,°°* in Co which covers S$ 


and is such that 
- oS 
pe Ste D> 2 paz 


= a L (Aina) + pA (A,-AYI 


A= | 


oo 
for some A in Cy. However, SMA is a subset of U (A;NA) and 


wot 


A, NA, AgMNA,*** is a sequence of sets in Co. Similarly S-A is a subset 


Oo 
of U (A;-A) and A,“A,Ag-A,*** is a sequence of sets in Cy. [t follows 


PS ° 


Hence 
ult See Con Ala CSA) 
; a a 

It follows that A is in Cy. 

LEMMA 2.1.25 

C, is a co -algebra which contains Co. 


3 
LEMMA 2.1.26 


~ 


, is a subset of C4. 
Restricting the domain of p™ to Y4 it follows that: 

LEMMA 2.1.27 

pe is countably additive. 


Proof: [Induction may be used to show 
yop 2 _s 
Vee (UA;) Zz j* A. 
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The statement is trivial for nel. Making the induction hypothesis, 


w+ 
and using WU A; as a test set, 


.=54 


" 
recalling that WU A; is in C. 
| 


A= 


mw A(OA)2 wi COA, (\ Ua ye +h ‘(Oat - UA.) 


ar : 
~ [A (OA) a Be: 


The induction hypothesis, A1"( UO Aj) = Eau, then emplies 
a=\ A = | 


YA 


we (UA — = 1s A; 


This completes the induction proof. However, since for all n, 


S Ai is a subset of hem 
p (Gare pw (UA,) 
2 » 
= A 
ke = ais oa 


Since this is true for all n, 


uN (UA Je way. 


= \ 


/ 


isecovered by @,,A7,°°° , from létea 2.1.17 


t thd 


Since the union of the y's 


ui (U Ai) < Sp Ai 


Hence 





LEMMA 2.1.28 
jae restricted to ® is unique. 
Proof: First consider some B in & such that 1A*B is tinite. [¢ is 
necessary to show that if AA, is a measure on 46 such that pA,yA equals 
jA*A equals LAA for every A in Cy» then 
MBa MB. 
To show this equality consider that for every 8 in 


pL B= uf pa jee. 


Hence for every ¢€S50, there exists a sequence Ay »Ag,*°° in Co which 


t Ooms 
B + € > a rN 
j/* ‘ =| ym bh 


Assuming the A,'s are disjoint it follows that 


Hence 


eB 2 M6. 


To show the reverse inequality, consider that since B is in Cs 


fe SU 


pr (U Ai) > poe ALB) + ye (Ua,-B). 


= be le rye (UaA.-B), 
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Since the A;'s are disjoint 


€ > Zw AL- wB 
=U A)- iB 
= uk ( U Ai-B) 


But for every €>O , there exists a sequence of sets BBL" in C, 
oO 
that cover WA,-B 


and are such that 
L=1 


pe ( UA,-B) < ZB. 


Taking the A,'s to be disjoint, it follows that 


2 pa Bi a 2 peo 


> uC UAB) 


Hence 


MA Uai-B) < rer CU a, -B) 


< €4+€ 


Furthermore 
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It follows that 


IBS WB. 


Hence 


BB= MiB 


Assuming /A™B is infinite, express R as the infinite union of 


OO 
bounded disjoint intervals. Then R = UO (€0,;,0,;], Further 


aw =I 


oO 
Demonia CO b; J and 


oa 


pee 
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= 2* (BN (ay, bil 
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THEOREM 2.2: 


If is a Lebesgue-Stieljes measure on®, then there exists a 


unique equivalence class M in E such that for every F in M and every 


a<b 


Mla, I =F(b)-F(aQ). 
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DEFINITION 2.2.1 


M(o,x] for x>0 
F (x), = 0 Lor == 36 


A(*,01 for x<o 


The proof of this theorem comes from the following lemmas: 
LEMMA 2.2.1- 
For every acb , 
JU, SN Sie 362) les (ou) 
Proof: There are five cases: 
Case l: If occa, 


Bota) =o ,ad and Fath) = ojnl 


However 


jAC0,b1 = U(o,al+ w(a,b] 
It follows that 


Rot D) > C0.) = aaiaal 
Case 2: If O=a, 


Fo(a)=O and FoCb)=u(0,b] = (a,b) 
Clearly 


Fi(b)-F,tay =n (a,b. 
The other three cases, when a <Q< b, b=O @&nd acb<o, follow in 
a similar fashion. 
LEMMA 2.2.2 


F. iS a monotone, non decreasing function defined for every x in R. 


8) 


Preof: For every x)>a 


Feo) - Fo Ca) = A(Q,x 1], 


30 















- a 
« « . 
—_: 


‘ay 








(as —— ‘am 


ett ed = ew Fee 
ae 


Ten 








ore FF 
i) heal oe) we G8 ‘e-8 








: ~— in? 


Since LU (a,x] 20 , it follows that for every x>a 


BaulGcs)) Palais ota) 


Since a is chosen arbitrarily, Ex is a monotone increasing function. 
Clearly Fy is defined for all x in R. 
LEMMA 2.2.3 

Fy 1s continuous from the right at every point of R. 


Proof: Select an arbitrary real number, a. Then 


oS wii (git 
CANO) | Eel COs ora) 0 C: Gu 
LA 
and 
pag galls: 
f0a.,a+] = F_ pa ' OL eee ) att] 
= 
The sequence of partial sums represented by this infinite series is mono- 


tone increasing and bounded by UA (a,atl] . Hence for every €>O there 


exists an N such that for every n)5N 
= | 
2, Ge ee Ce SG, 
form a 

However since 


Baar =-2 plartiyared, 


L+ | 
it follows that 


Im-o (a+L)-Fl(ay<é 


Since Fy is monotone non-decreasing 


Fx) = een sc 


for every x in (a,a+t). Therefore F, is continuous on the right at a 


where a is an arbitrary real number. 
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LEMMA 2.2.4 
F, is ink, 


DEFINITION 2.2.2 


Let M be the equivalence class in /( which contains Eas 


LEMMA 2.2.95 


For every F in M and every a<b, 


Ye a 


Proof: Since F is in M, there exists a real number C such that for every 
xe R, 

Fr rae ey 
Thus 


6a, 


Eb) - F(a) 


Rib y+C-FeCay-Cc 
F Gp) =a ca). 


This completes the proof of the theoren. 


The following is noted 
however: 


LEMMA 2.2.6 


Si ay Vo? (0 ae 


xa 


The proof is similar to the proof of lemma 2,2.3. 
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Chapter 3 

PART I: THE DEFINITION OF THE LEBESGUE-STLELJES INTEGRAL 

The Lebesgue-Stieljes integral of a bounded point function g with 
respect to 4a Lebesgue-Stiel jes measure JA , or with respect to any func- 
tion F in the equivalence class of M that corresponds to U4 over a Bore L 
set B such that 44 B is finite will be defined. The definition will be 
extended to functions g Chat are not bounded on 8, te Lebesgue-Stieljes 
sade saa such that UB is infinite, to functions F that are monotone 
non-decreasing on R but not continuous on the right and finally to func- 
tions F of bounded variation on B. Some preliminary definitions are 
necessary: 
DEFINITION 3.1.1 

For a given sorel set B, Dy is defined to be a collection of n dis- 


joint Borel sets B,,Bo,°-+ ,Bn such that 


B,=B. 


<= 


DEFINITION 3.1.2 
The upper Darboux sum of a bounded function g with respect to 4 
Lebesgue-Stiel jes measure AA and a given D, on a Borel set B of finite 


/j-measure is 


ZM, mere 


= 


a 


where B),B9,*°+,B, “re the elements of D, and Mj is the supremum of g 
on By. 
DEFLNITION 3.1.3 


The lower Darboux sum of a bounded function g with respuct to a Le- 


besgue-Stieljes i ne and with respect to 4a given D, over a Bore) 
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set B of finite (A-measure is 


where B,),B2,°°*,Bpy) are the elements of D and M is che infimum of g on B;. 
DEFINITION 3.1.4 
The upper integral of a bounded function g with respect to a Lebesgue-~- 


Stiel jes measure j« over a Borel set B of finite jA-measure is 
“\ 
int 7_M. B, 
A= Lf - 


where the infimum is taken with respect to all D,'s for all values of n. 


The upper integral is denoted by 


S,qadp or Sad 
& Sie 64 
where F is any function in the equivalence class corresponding CO UA. 


DEFINITION 3.1.5 
The lower integral of a bounded function g with respect to a Lebe: giec- 


Stieljes measure {A over a Borel set B of finite ys. -measure is 


sup Zw, pBy 


t= 


where the supremum is, taken with respect to all D,'s for all values of n. 


The lower integral is denoted by 


| OMe Orc: eee 
+B 4op Ls 
where F is defined as in definition 3.1.4. 


DEFINITION 3.1 


A bounded function g is Lebesgue-Stieljes integrable with respect to 
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the Lebesgue-Stiel jes measure A4 over a Borel set B of finite ,. -measure 
if the upper and lower integrals are equal and finite. The common value 
of the upper and lower integrals is called the Lebesgue-Stieljes integral 


and is denoted by 


a 9 bp uF i ad 


THEOREM 3.1: 
A necessary and sufficient condition for the existence of Is 4 re 


is that for every +O  , there exists a D, such that 


al 
2. (Mal MBE << 
Ast 


Proof: Clearly each upper Darboux sum is greater than or equal to each 


lower Darboux sum. [It follows that 


= 


ha 4 MA oe la \ Ape 


h 
For every ¢>O there exists a D, and a D, such Chat 


—_— 


“\ , 
> M5, = RX 
CW Mile dsc —)\ 


and 


aN 

.- eo “ 7 
le qyer 2 We gy WHS 52 

tot f 


These inequalities continue to hold when D, and D,, are replaced by 
f 
fe . JL ae Bae f iA Pe ; 
D, = , BAB, ame Bye Wien Oe ne If Jp Bau exists, the 


upper and lower integrals are equal by definition. It follows that the 


stated condition is necessary. Conversely, if the condition is satisfied 


= 


a { iu! ey es 4 Lye “4 & 
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Since the inequalities hold for every ¢>© the upper and lower inte- 
grals must be equal. 
THEOREM 3.2: 

If AB is finite and g is Borel measurable and bounded on B, the 
he g, d pA ExXESES, 


Proof; Take | + MB 7 O and any finite number of points 


Yoru Yn such that 

ae = Mit ert xe teoreganl ©x in B., 

ee Mi= sup £(x) for all xinsB , 

mM = Va eS GI 
and 

Sis. 

Ve Hos < 1+ for is ie ae 
het 

mead se xis in B and Huns GOS 4a 

=4 x: XK ism BD ana goosait Ate x « in B and g>44 


Since g is Borel measurable, B; is the intersection of two Borel sets 
ane therefore a Borel set. It follows that 1.B; is defined. If M; is 


the supremum of g(x) for x in B; and ms is the infimum of g(x) for x in 


By > it follows that 
Yin <m. = ee <M; fyi. 
It follows that 


c 
Ya a \4peB 
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It follows from theorem 3.1 that the Lebesgue-Stieljes intergral exists. 


DEFINITION 3.2 


If gis not bounded on B, define 


\. q oy = Lim aay dy 


> ae 
b> v= 
were 
a for g(x) a 
Foss <*? = g(x) for a gfx} b 
b for b atx * 


provided the above limit exists. 
DELTNETION 3.3 
LE A B is infinite, define 


\ 4 dys Senn Bey 4 pt 


wos - bo 


wifSrea 


4 


rie . = ON ao) 


proviced Cie Mimit exiats., 


DEF MNETION 3.5 


Lf F is monotone non-decreasing but not continuous on tho rignt, 
Gcefrine 


a7 





i q dF = 154 ee 
where 


F* (x) - lim F(x) 


X“—> x 


for all x in B provided the integral with respect to F exists. 
DEFINITION 3.6 


If F ts of bounded variation on R, define 


Ye gdF= Sa qdF, - Sag dhe 


where 


= (—,-F2 


and F) and Fj are monotone non-decreasing provided the integrals with re- 


Spect to F, and Fo exist. 
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PART II: PROPERTIES OF THE LEBESGUE-STIELJES INTEGRAL 

Properties will be derived for the Lebesgue-Stieljes integral of a 
bounded Borel measurable function g with respect to a Lebesgue-Stieljes 
measure jp over a Borel set B of finite /A measure. These properties 
will be useful in Chapter 4. 
THEOREM 3.3 

1Ga By>° 6° Bn is a finite collection of bounded Borel measurable func- 
tions, 

ny n 
‘| 2 An du = 2 Ig qi du 

Proof: Since g, and go are bounded and Borel measurable, so is Bit Bo: 


= int ae Vilar 1 anys 


where mos is the infimum of 81 (X) + Bo (Xx) for all x in B; and Moi is 


the supremum of g,(x)+ 8 9(x) for all x in B; . Furthermore 


MMOS ay or 


where mm, is the infimum of g,(x) and ms is the infimum of S5(x) for all 


1 


x Et B.5 moreover 


where Mj; and Mo; are defined in the cbvious way. It follows that 


PEN Bb, 2 = Cm,,+ Mai) PE: 


ce 
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and 


= n 
= Mo. BBA S aa M+ Maz) WB; 


Since g, and 8) are integrable, it follows that 


i q.Op. + In. gadu= Sup = + sup > Ma, BB: 
=sup 7 Zz (mis Mz.) MB; 


= int Z_\M Mia tMy:) yey 


- 
-_ 


But since 


lies lrg SM talec SS NIB SESW Eee Moi ; 
it foliows that 


13, Au + ip G23 ph = ne 


The conclusion follows by induction 


>) Ya 
THEOREM 3.4 


If B, and By are disjoint Borel sets of finite j,-measure whose 
union is B, then 


_ gdp. : be Gd ea Jp G Ip. 


Proof: Define 


ACO = 1 Tans aa 


O For x any Be 
and 


Gz) = ae for K iN B, 


SB: for x in B, 
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Then 
Jaqdy = Jy (Gr ga) du 
=f, adn + Ja qade 
=Saqdr + Jagd, 
THEOREM 3.5 


MAB S Ve Goa = MuB 


where m is the infimum and M, che supremum of g(x) for all x in B. 
Proof: Letting By ,B2,+:°*,B, be a sequence of disjoint Borel sets whose 
union is B and letting M; be the supremum of g(x) for all x in B;, it 


follows that M; <M for all i. Thus 


vas Mi By < ae M ub, 


AeA 
=M . 
wb 


Similarly 


Za my MB: << mB, 


But when the Lebesgue-Stieljes intergral exists 


a v"\ 
inf Mist a= Seo omina Uae. 
anaoteplial! 1° <8 Ea AM 


uF 


It follows that 


MAB < ‘a q dA < MiLB. 


Al 












a 


| oS el 





ars 


a 


ttle eee ae § @ 
ipwmagiae =e 


COROLLARY 3.5.1 


If MB=O , ~ qd =O 


THEOREM 3.6 
a qdp < algal gu, 
Proof: Clearly 


IQoo| + — pie) and Lacs = Qin) ZO 


Letting m, be the infimum of lg(x)l + g(x) for all x in B and o., 


the infimum of |g(x}| — g(x) , it follows that 
Os m, WB 
= iqidu + Je Gop 
Hence 
I, gdu < Mal qidu 
Similarly 


Ox M2 MB 
= Paley ta Lardy, 
Since it follows directly from the definition that a constant may be fac- 


torecd across the integral sign, 


) Gye < Fs 1g lope. 


Hence 


| i 4 vo |S ie | 4 Lig. 
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Riemer 3. / 

Suppose 4 is a Lebesgue-Stieljes measure, B is some Borel set of 
finite 14 -measure and g),89,°°° is a sequence of Borel measurable func- 
tions defined on B and such that for every n and for every x in B there 
exists a real number KX such that 


| Qs) | 6% 


Suppose moreover that 


Lim Son == ie 


mn ~~ oO 


almost everywhere i.e, for all x in p= Be pace ae - 9. Finally sup- 


pose that g is bounded on B. [t follows that 


lim a Gade = ie lim Qn Ole 


Nn —> oo 


Proof: Since g is bounded on $ = TS Lee. , it is obvious that 


a GY ai 
Lemeivse hE. s BS , g is the himit of a sequence of Borel measurable 
functions on B” and hence g is Borel measurable. Moreover lecxyl < kK 
for all x in B*. It follows that g(x) is integrable over B* and hence 


the fellowing integrals exist and 


Ve Oy = ) qd + ba qdu 


i a gum. 


For every ©>0O 4a non-decreasing sequence of subsets of BR may be 
defined as follows: 
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as << (G0) 4.0? |< an for Cone | 


Bf mt nix) - oe [<7 for N= 2,3 000 


B= 4x: IGnted = Gil Ce” for eens 


a 


Cs. ne 


Z (i+ B) 


wnere €¢ 
Sdage By is a subset of B* for every i 
ie . 
UBC B"* 
=k 


® « a 
Furthermore x in B implies Lim g,(x) equals g(x). This means that for 
nn a oO 
every €>0O there exists an m such that for every n>m , x is in B,. 


In symbols 


ee One 
Ie follows that 
B= UB; 


Since B,(l39C--, 


OG DO 
Cie ee me U\B_-B;). 


ae) 


Thus since the sets on the right are disjoint Borel sets 
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This means that there exists an m such that for every nom 


Drosera acme 
oe 


Since it may be easily shown that [g,-g| is a bounded, Borel measur- 
able function, it follows that |g ,-g{ is integrable and hence for 


every n>m 


Nelgeegldu ede Vgargl du + Sg 1G-Galdy 


< € KBr + 2K UB-By) 


Since 


a Go-G) dpe | < ie qn74| Sit , 


it follows that for every €>50, there exists anim such that for every n > 
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THEOREM 3.8 
—— 
Lf per. & 2 Gtx) almost everywhere on some Borel set B of in- 
i= 
finite 1. -measure, if g is bounded on B and if there exists a real number 


4 ( 
K such that for all x in B and for all n, | 2 GO \e K then 


2 Safidu=Sn(Z f,) 

i a one a 

Proof: This is an inmediate consequence of theorem 3.7 considering tie 
sequence of partial sums. 

THEOREM 3.9 


If B),B9,°:* is a sequence of disjoint Borel sets whose union is B, 


la gd 22 be, 4d: 


— 
Proof: Define e. (X) to oe i when x is in B; and zero otherwise. Then 
for am. & an, T, 
oD 
a = pa Co) Se 
os | 


rence 


= Z Le S.4 Vf 
wr th 
olla 
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Chapter 4 
PROBABILITY INTEGRALS 

In this section probability measure and probability distribution 
function will be defined. Then it will be shown how the Lebesgue- 
Stieljes integral of a bounded Borel measurable function g with respect 
to a probability measure may be expressed as a countable sum of positive 
numbers plus the Lebesgue-Stieljes integral of g with respect to a func- 
tion that is everywhere continuous. 
DEFINITION 4.1 

If F is monotone non-decreasing, defined on R and continuous from 


the right, i.e. if F is an element of Mand if lim F(x) = 0 and 


X —-- CO 


lim F(x) = 1, then F is a probability distribution function. 


K +00 
DEFINITION 4.2 
LE yo is the unique measure determined by a probability distribution 
function, pis a probability measure and for any Borel set By, JAB will 
be denoted by P(B). P(B) is the "probability" that x is in B. 
THEOREM 4.1 


If P is a probability measure, 
Moreover for all Borel sets B, 


THEOREM 4.2 
If pee a Lebesgue-Stieljes measure, yf a} is greater than zero if 
and only if a is a point of discontinuity for every function F in the 


equivalence class corresponding iy coat 
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Proof: First assuming that a is a point of discontinuity, it follows 
from the fact that every F is monotone non-decreasing and continuous on 
the right that 


lim F(x) < lim F(x) = F(a). 


But 
Lim pr («ad = lum JED i oa Ca} 
os. oe Cee 
= wha} 
Further 


Lim BOX e) = lum ( Fay —- ae >oO 


Xx—> OL 
It follows that plat>o 


On the other hand, assuming that plas >O 
Lim een ee = PLat> Oo 
K—>G>- 
Hence F is discontinuous at a. This clearly holds for all F in the 
equivalence class corresponding oe 
COROLLARY 4.2.1 
JAA a} = QO if and only if a is a point of continuity of F for all 
F in the equivalence class corresponding to hb: 
THEOREM 4,3 
For all functions F in Af there are at most a countable number of 
discontinuities, 
Proof: Suppose a is a point of discontinuity for F. Then 


F(a) = Lim F(x} > Lim F(x). 
X—> G+ x—>ae 
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Mate 2 with a rational number r such that 


lim F(x) -< © < Eim FCs). 


x— a- x —> A+ 


Since F iS monotone non-decreasing, each distinct point of discontinuity 
corresponds to @ distinct rational number. Since the rationals are 
denumorable, the points of discontinuity are countable. 
TREOREM 4.4 
Tf F is a probability distribution function 

Fs f+S 
where f£ is continuous on R. 
Proof: Let x be the points of discontinuity for F. x is a Borel set 
since x is a countable union of distinct points and each point is a Borel 
set. Moreover R-x is the points of continuity for F and is also a 
Borel set. Suppese P is the probability measure that corresponds to F. 
Then for all Borel sets B, 


P(B)= PCBAYX) +P (B-Z) 
Define 


py ee) and }A28 = (eae) 

Then Ky eu )4 9 are boundea Lebestue-Stieljes measures. For all x define 
Fond 2 fA, (- 00,x7] and Oye 2 

Then f is in the equivalence class corresponding tc My and S is in the 


equivalence class corresponding CO A2s 


fTnen for all x, 
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If x is in R-x 


pede =P L{«}-E] = Pixb=o 
Hence Ax} is zero for all x in R. Since £ is in the equivalence 
class corresponding ea EGyt it follows that f is continuous for all x. 


THEOREM 4.5 

If x} and x» are two points in X and no points of x are in 
(X1 5X5); 
Then for every x in [x),x5) , S(x) = S(x,)- 


Proof: For every x in [*, »X5), 
P [-e xI NZ) = P [(-00 xn) + PLOW, Nk 
=P LG, «IN x | 
Hence 
Plem <IN EI = py cml 
= 9.x) = DiGa):, 


THEOREM 4.6 


S is continuous at all x in R-x and discontinuous at x in xs 
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Proof: For x in R-x , 


TEN =PL{ixtnzl=P¢g <0 
Hence x is a point of centinuity for S. 


For x in x 


Pyled = PUK NE] s P{x}>oo 
Hence x is a point of discontinuity for S. 
DEFINITION 4.3 
A function having the properties attributed to § in theorems 4.5 
and 4,6 will be called a generalized step function. 
THEOREM 4.7 


5 qdF al QOGY peg eit a i Q op 


¥ NB 


where g is bounded and Borel measurable on the Borel set B, F is a prob- 
ability distribution function and X, 2, and fo are as defined in 
theorem 4.4, 


Proof: By definition 


1, gdF = int ra M,; 7 (B;) 


inf 2 Mee mays 
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Chapter 5 
CONCLUS ION 
A bounded Borel measurable function which gives an important special 
case of the general formulas in the preceding chapters is g{x) =< 1 for 
all x. If g(x) =< 1 , for any Borel set, B, and any probability distribu- 
tion function, F, the probability that x is in B is given by 
Pc’) = lade 
Suppose F is continuous everywhere. It mav be shown that F has a 
derivative at every point with che possible exception of a set of 
Lebesgue measure zero C21. 1 tne derivative of F,F% exists everywhere, 
it is called the probability density function. Furthermore it may be 


shown that 


), dx = Je dF = PCB). 


In particular if B is the interval from a to b 
b , a — 
P(B) =), Fax =F Cb)-FCa)y 


This is true regardless of whether the interval is (a,b), {a,b], [a,b) 
or [a,b]. If B is a single point P(B) is clearly zero. 

Suppose F is a generalized step function, i.e. F(x) = S(x). The 
set of points at which F is discontinuous x is either a finite or 
denumerable set. The function p is called the probability density func- 


tion for F where 


P6xj) =F cx.) - lim  (x;) for «K- in Xx. 


ae 
xe ~~ 
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era for x not in x. 
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The probability that x is in a Borel set B is 
ie dF = a pox) 

The set X may be such that every point of x is in an interval con- 
taining no other points of X. In this case X is said to be discrete. 
The discrete case includes the case where X has a finite number of 
points in every finite interval. In this case F is a step function in 
the ordinary sense [3]. It may also happen that 8 is discrete but has 
a denumerable number of points in some finite interval. For example 
let 

=| Vi4r, ae 
and define 
O for «<i. 
EF cxd=s Ze for x in ene) » E12 °°", 
| tor x in C1, 00). 

Also the set X may be such that there exists a denumerable set of 

x, 'S in every interval. In this case X is said to be everywhere dense. 


For example let * be the set of all rational numbers, r},¥9,°**. Define 


and let 


Fox > = pad eee 
% Sx 
Finally F may of course be the sum of a non zero continuous func- 
tion and a non zero generalized step function. 
The two cases uSually discussed in clementary probability courses 
are where F is everywhere differentiable (and hence continuous), and 


where F is an ordinary step function. 
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